Information processing apparatus, control method, and program

ABSTRACT

An information processing apparatus (2000) includes a summarizing unit (2040) and a display control unit (2060). The summarizing unit (2040) obtains a video (30) generated by each of a plurality of cameras (10). Furthermore, the summarizing unit (2040) performs a summarizing process on the video (30) and generates summary information of the video (30). The display control unit (2060) causes a display system (20) to display the video (30). Here, the display control unit (2060) causes the display system (20) to display the summary information of the video (30) in response to that a change in a display state of the video (30) in the display system (20) satisfies a predetermined condition.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.16/674,082 filed Nov. 5, 2019, which is a Continuation of U.S.application Ser. No. 16/347,262 filed May 3, 2019, which is a NationalStage of International Application No. PCT/JP2016/082950 filed Nov. 7,2016.

TECHNICAL FIELD

The present invention relates to an information processing apparatus, acontrol method, and a program.

BACKGROUND ART

A video of a camera is used in various scenes. For example, videosurveillance using the video of the camera (so-called a surveillancecamera) which images a place to be surveilled is performed.

According to such a background, a technology for easily handling thevideo of the camera is developed. For example, Patent Document 1discloses a technology of detecting an important scene from asurveillance video and generating a summary video in which frames otherthan the important scene are omitted.

RELATED DOCUMENT Patent Document

-   [Patent Document 1] Japanese Unexamined Patent Publication No.    2012-205097

SUMMARY OF THE INVENTION Technical Problem

In the video surveillance or the like, there is a situation in which oneperson (for example, a surveillant) has to watch a plurality of videos.For example, in a case where a plurality of places to be surveilled areimaged by different surveillance cameras, the surveillant has to viewall of videos generated by a plurality of cameras and recognize a placeat which an abnormality occurs. This operation requires a lot ofworkload for the person who watches the video.

The present invention is provided in view of the problem describedabove. One object of the present invention is related to provide atechnology for easily viewing a plurality of videos.

Solution to Problem

An information processing apparatus of the present invention includes:(1) a summarizing unit which obtains videos and generates summaryinformation of the obtained video by performing a summarizing process onthe obtained video, each of a plurality of cameras generating the video;and (2) a display control unit which causes a display unit to displaythe video.

In response to that a change in a display state of the video on thedisplay unit satisfies a predetermined condition, the display controlunit causes the display unit to display the summary information of thatvideo.

A control method of the present invention is executed by a computer.

The control method includes: (1) a summarizing step of obtaining videosand generating summary information of the obtained video by performing asummarizing process on the obtained video, each of a plurality ofcameras generating the video; and (2) a display control step of causinga display unit to display the video.

In the display control step, in response to that a change in a displaystate of the video on the display unit satisfies a predeterminedcondition, the display unit displays the summary information of thatvideo.

A program of the present invention causes a computer to execute eachstep included in the control method of the invention.

Advantageous Effects of Invention

According to the present invention, there is provided a technologycapable of easily viewing a plurality of videos.

BRIEF DESCRIPTION OF THE DRAWINGS

The above objects and other objects, features and advantages will becomemore apparent from the following description of the preferredembodiments and the accompanying drawings.

FIG. 1 is a diagram conceptually illustrating an operation of aninformation processing apparatus according to Example Embodiment 1.

FIG. 2 is a diagram illustrating the information processing apparatusaccording to Example Embodiment 1 and a use environment of theinformation processing apparatus.

FIG. 3 is a diagram illustrating a computer for realizing theinformation processing apparatus.

FIG. 4 is the first diagram illustrating a display state of a video in adisplay system.

FIG. 5 is the second diagram illustrating the display state of the videoin the display system.

FIG. 6 is a third diagram illustrating the display state of the video inthe display system.

FIG. 7 is a fourth diagram illustrating the display state of the videoin the display system.

FIG. 8 is a flowchart illustrating a flow of a process executed by theinformation processing apparatus according to Example Embodiment 1.

FIG. 9 is a diagram illustrating summary information in a table format.

FIG. 10 is the first diagram illustrating timing when displaying summaryinformation of a video based on the first example of a predeterminedcondition.

FIG. 11 is a diagram illustrating a scene in which the summaryinformation of the video is displayed based on the second example of thepredetermined condition.

FIG. 12 is a diagram illustrating a scene in which the summaryinformation of the video is displayed based on a third example of thepredetermined condition.

FIG. 13 is the first diagram illustrating a display state of the summaryinformation.

FIG. 14 is the second diagram illustrating the display state of thesummary information.

FIG. 15 is the first diagram illustrating a scene of generating thesummary information.

FIG. 16 is a diagram illustrating a scene in which a display controlunit selects the summary information to be displayed to a displaysystem.

FIG. 17 is the first diagram illustrating a scene of updating thesummary information.

FIG. 18 is the second diagram illustrating a scene of updating thesummary information.

FIG. 19 is a diagram illustrating a supposed environment of aninformation processing apparatus according to Example Embodiment 2.

FIG. 20 is a diagram illustrating priority information in a tableformat.

FIG. 21 is a diagram illustrating a relationship between a staying timeand a priority of summary information.

FIG. 22 is a diagram illustrating a temporal change in a score ofsummary information.

DESCRIPTION OF EMBODIMENTS

Hereinafter, example embodiments according to the present invention willbe described by using the drawings. In all of the drawings, the samecomponents are denoted by the same reference numerals, and descriptionthereof is not repeated as appropriate. In addition, unless otherwisedescribed, in each of block diagrams, each of blocks represents not ahardware unit but a functional unit configuration.

Example Embodiment 1

<Outline of Operation of Information Processing Apparatus 2000>

FIG. 1 is a diagram conceptually illustrating an operation of aninformation processing apparatus 2000 according to Example Embodiment 1.Note that, FIG. 1 is a diagram for facilitating understanding of theoperation of the information processing apparatus 2000, and theoperation of the information processing apparatus 2000 is not limited byFIG. 1 .

A camera 10 performs imaging and generates still image data or videodata. A video 30 is video data based on an imaging result of the camera10.

The video 30 is displayed on a display system 20. Accordingly, a user ofthe information processing apparatus 2000 can view the video 30. Forexample, the information processing apparatus 2000 is an apparatus whichprovides a surveillance video to a surveillant. In this case, the camera10 is a surveillance camera which images a place to be surveilled. Inaddition, in this case, the user of the information processing apparatus2000 is a surveillant or the like who surveils the surveillance place byviewing the video 30.

The information processing apparatus 2000 generates summary informationof the video 30. The summary information of the video 30 indicates anyinformation obtained from contents of the video 30. For example, thesummary information indicates a staying time, a trace of movement, andthe like of a person captured in the video 30.

The information processing apparatus 2000 causes the display system 20to display the summary information of the video 30. The summaryinformation in FIG. 1 is an arrow indicating a trace of movement of theperson captured in the video 30.

Here, the summary information of the video 30 is displayed in responseto that a predetermine condition is satisfied regarding a change in adisplay state of the video 30 on the display system 20. By watching thesummary information of the video 30, the user of the informationprocessing apparatus 2000 can easily recognize contents of the video 30in the past.

<Outline of Configuration of Information Processing Apparatus 2000>

FIG. 2 is a diagram illustrating the information processing apparatus2000 according to Example Embodiment 1 and a use environment of theinformation processing apparatus 2000. The information processingapparatus 2000 includes a summarizing unit 2040 and a display controlunit 2060. The summarizing unit 2040 obtains the video 30 generated byeach of a plurality of cameras 10. Furthermore, the summarizing unit2040 performs a summarizing process on the video 30 and generatessummary information of the video 30. The display control unit 2060causes the display system 20 to display the video 30. Here, the displaycontrol unit 2060 causes the display system 20 to display the summaryinformation of the video 30 in response to that a predetermine conditionis satisfied regarding a change in the display state of the video 30 onthe display system 20.

Advantageous Effect

In the information processing apparatus 2000 according to the presentexample embodiment, each of the plurality of cameras 10 generates thevideo 30. In such a case, a user (for example, a surveillant) of theinformation processing apparatus 2000 who views the video 30 has torecognize occurrence of an abnormality or the like from a plurality ofvideos 30. However, a lot of workload is required to recognize contentsof the plurality of videos 30. Also, it is apprehended that an importantscene in the video 30 may be overlooked.

In the information processing apparatus 2000 according to the presentexample embodiment, the summary information, in which the contents ofthe video 30 are summarized, is generated. In addition, the summaryinformation is displayed on the display system 20 in response to that apredetermine condition is satisfied regarding a change in the displaystate of the video 30 on the display system 20. Here, if thepredetermined condition is appropriately determined, it is possible todisplay the summary information of the video 30 on the display system 20at the timing that it is appropriate for the user to easily recognizethe contents of the video 30. Therefore, according to the informationprocessing apparatus 2000 of the present example embodiment, it becomeseasy to view the plurality of videos 30. As a result, it is possible torealize to decrease the workload of the user who wants to view theplurality of videos 30, and to prevent an important scene from beingoverlooked.

Hereinafter, the present example embodiment will be described in detail.

<Hardware Configuration Example of Information Processing Apparatus2000>

Each of function configuration units of the information processingapparatus 2000 may be realized by hardware (for example, hard-wiredelectronic circuit or the like) which realizes each of the functionconfiguration units or may be realized by a combination (for example, acombination of the electronic circuit and a program controlling theelectronic circuit or the like) of hardware and software. Hereinafter, acase where each of the function configuration units in the informationprocessing apparatus 2000 is realized by a combination of hardware andsoftware will be further described.

FIG. 3 is a diagram illustrating a computer 1000 for realizing theinformation processing apparatus 2000. The computer 1000 is apredetermined computer. For example, the computer 1000 is a personalcomputer (PC), a server machine, a tablet terminal, a smartphone, or thelike. The computer 1000 may be a dedicated computer designed to realizethe information processing apparatus 2000 or may be a general purposecomputer.

The computer 1000 includes a bus 1020, a processor 1040, a memory 1060,a storage 1080, an input and output interface 1100, and a networkinterface 1120. The bus 1020 is a data transmission line through whichthe processor 1040, the memory 1060, the storage 1080, the input andoutput interface 1100, and the network interface 1120 mutually transmitand receive data. However, a method of connecting the processors 1040and the like to each other is not limited to bus connection. Theprocessor 1040 is an arithmetic apparatus such as a central processingunit (CPU), a graphics processing unit (GPU), or the like. The memory1060 is a main storage device realized by using a random access memory(RAM) or the like. The storage 1080 is an auxiliary storage devicerealized by using a hard disk, a solid state drive (SSD), a memory card,a read only memory (ROM), or the like. However, the storage 1080 may beconfigured with the same hardware as the hardware constituting the mainstorage device such as a RAM.

The input and output interface 1100 is an interface for connecting thecomputer 1000 and an input and output device. The network interface 1120is an interface for connecting the computer 1000 to a communicationsnetwork. The communications network is, for example, a local areanetwork (LAN) or a wide area network (WAN). A method by which thenetwork interface 1120 connects to the communication network may be awireless connection or a wired connection.

For example, the computer 1000 is communicably connected to the camera10 through a network. However, a method of communicably connecting thecomputer 1000 to the camera 10 is not limited to a connection throughthe network. In addition, the computer 1000 may not be communicablyconnected to the camera 10.

The storage 1080 stores a program module which realizes each of thefunction configuration units (the summarizing unit 2040 and the displaycontrol unit 2060) of the information processing apparatus 2000. Byreading each of these program modules into the memory 1060 and executingthe program module, the processor 1040 realizes a function correspondingto each of the program modules.

Note that, the information processing apparatus 2000 may be realized byusing a plurality of computers 1000. For example, the informationprocessing apparatus 2000 can be realized by two computers, that is, thefirst computer 1000 which realizes a function of the summarizing unit2040 and the second computer 1000 which realizes a function of thedisplay control unit 2060. In this case, the first computer is acomputer which performs a process for generating summary information. Onthe other hands, the second computer is a computer which performs aprocess for displaying the summary information to the display system 20.The second computer obtains the summary information from the firstcomputer by a predetermined method.

As described above, for example, the first computer 1000 and the secondcomputer 1000 are realized by a PC, a server machine, a tablet terminal,a smartphone, or the like. However, the first computer 1000 may berealized by the camera 10. In this case, the camera 10 performs thesummarizing process on the video 30 generated by the camera 10 andgenerates summary information. The second computer 1000 obtains thesummary information generated by the camera 10. The camera 10 having afunction of the summarizing unit 2040 in this manner is, for example, acamera called an intelligent camera, a network camera, an internetprotocol (IP) camera, or the like.

<<Camera 10>>

The camera 10 is any camera which performs imaging and generates stillimage data or video data. The video 30 is configured based on the datagenerated by the camera 10. For example, the video 30 is the video datagenerated by the camera 10. In another example, the video 30 isconfigured with a sequence of a plurality of pieces of still image datagenerated by the camera 10.

The camera 10 may be a camera whose position is fixed (hereinafter,referred to as a fixed camera) or whose position is not fixed(hereinafter, referred to as a moving camera). The fixed camera is acamera installed in various places such as a wall, a pillar, or aceiling. A place at which the fixed camera is installed may be indoor oroutdoor.

Note that, the wall or the like on which the fixed camera is installedis not limited to a real property, and may be fixed for a certainperiod. For example, the wall or the like on which the fixed camera isinstalled may be a partition, a pillar, or the like temporally installedat an event hall or the like.

In another example, it is possible to stop a moving object equipped witha camera usable also as a moving camera to be described below at acertain place and to use that camera as a fixed camera. The movingobject is, for example, a car, a motorcycle, a robot, a flying object(for example, a drone or an airship), or the like.

The moving camera is, for example, a camera which is put to a person orattached to the moving object or the like described above. The movingcamera put to the person is, for example, a camera held by a hand (acamera of a mobile terminal such as a video camera, a smartphone, or thelike), a camera fixed to a head, a chest, or the like (wearable cameraor the like), or the like. The camera attached to the car, themotorcycle, the robot, the flying object, or the like may be a cameraattached for use as a so-called drive recorder, or may be a cameraattached separately for generating the video 30 to be provided to theinformation processing apparatus 2000.

A place imaged by the camera 10 is arbitrary. For example, in a casewhere the camera 10 is a surveillance camera, the camera 10 images aplace to be surveilled. The place to be surveilled is, for example, aroute in or around the event hall, a route between the event hall and anearest station of the event hall, or the like. Note that, the placeimaged by the camera 10 may be indoor or outdoor.

<Display System 20>

The display system 20 is configured to include one or a plurality ofdisplay devices. Hereinafter, some examples of a display state of thevideo 30 in the display system 20 will be described. Note that,hereinafter, an example in which the display system 20 is configured toinclude one display device 22.

FIG. 4 is the first diagram illustrating the display state of the video30 in the display system 20. The display device 22 in FIG. 4 includes adisplay area 24 in which the video 30 is displayed. The display controlunit 2060 sequentially displays the plurality of videos 30 in thedisplay area 24.

For example, it is assumed that a video 30-1 and a video 30-2 arerespectively generated by two cameras 10-1 and camera 10-2. In thiscase, the video 30 is displayed in the display area 24 in order of thevideo 30-1, the video 30-2, the video 30-1, the video 30-2, . . . .

FIG. 5 is the second diagram illustrating the display state of the video30 in the display system 20. The plurality of videos 30 are displayed onthe display device 22 at the same time. Specifically, a plurality ofdisplay areas 24 having the same size are provided to the display device22, and each of the different videos 30 is displayed in each of thedisplay areas 24.

In this case, it is assumed that the number of videos 30 (the number ofcameras 10) is larger than the number of display areas 24. In this case,in each of the display areas 24, the plurality of videos 30 aresequentially displayed. For example, it is assumed that the number ofvideos 30 is 8 and the number of display areas 24 is 4. In this case,the display control unit 2060 alternately displays two videos 30 in eachof the display areas 24.

FIG. 6 is a third diagram illustrating the display state of the video 30in the display system 20. The display device 22 in FIG. 6 also includesthe plurality of display areas 24. However, in the display device 22 ofFIG. 6 , there are two types of display areas 24 having different sizes.Sizes of a display area 24-2 to a display area 24-8 are all the samesize. On the other hand, the size of a display area 24-1 is larger thanthe sizes of the other display areas 24.

The different videos 30 are respectively displayed from the display area24-1 to the display area 24-8. The video 30 displayed in the displayarea 24-1 is automatically determined, for example, by the displaycontrol unit 2060. For example, the display control unit 2060 displaysthe plurality of videos 30 in the display area 24-1 in turn.

In another example, the video 30 displayed in the display area 24-1 maybe selected by the user of the information processing apparatus 2000.For example, it is assumed that the display device 22 includes a touchpanel. In this case, the user performs an operation of touching any oneof the display area 24-2 to the display area 24-8. According to thisoperation, the display control unit 2060 changes a display position ofthe video 30 displayed in the touched display area 24 to the displayarea 24-1.

FIG. 7 is a fourth diagram illustrating the display state of the video30 in the display system 20. FIG. 7 is the same as FIG. 6 except thatFIG. 7 includes the plurality of display areas 24 having large size.

As described above, here, the display system 20 may be configured with aplurality of display devices 22. For example, in this case, each of theplurality of display areas 24 in the example described above is realizedby one display device 22. In this case, the display control unit 2060handles each of the display devices 22 in the same manner as the displayarea 24 in the example described above.

<Flow of Process>

FIG. 8 is a flowchart illustrating a flow of a process executed by theinformation processing apparatus 2000 according to Example Embodiment 1.The summarizing unit 2040 obtains the video 30 from each of the cameras10 (S102). The summarizing unit 2040 generates summary information ofthe video 30 (S104). In a case where a change in the display state ofthe video 30 satisfies a predetermined condition (YES in S106), thedisplay control unit 2060 causes the display system 20 to display thesummary information of the video 30 (S108).

Note that, as described below, timing when a process (S102 and S104) forgenerating the summary information is executed and timing when a process(S106 and S108) for displaying the summary information to the displaysystem 20 is executed are various. Thus, these processes do not have tobe executed sequentially as illustrated in FIG. 8 . The timing whengenerating the summary information and the timing when displaying thesummary information will be specifically described below.

<Method of Obtaining Video 30: S102>

The summarizing unit 2040 obtains the video 30 (S102). A method by whichthe summarizing unit 2040 obtains the video 30 is arbitrary. Forexample, the summarizing unit 2040 receives the video 30 transmittedfrom the camera 10. In another example, the summarizing unit 2040accesses the camera 10 and obtains the video 30 stored in the camera 10.

Note that, the camera 10 may store the video 30 in a storage deviceprovided outside the camera 10. In this case, the summarizing unit 2040accesses the storage device and obtains the video 30. Note that, each ofthe videos 30 generated by the plurality of cameras 10 may be stored inthe same storage device or may be respectively stored in differentstorage devices.

In a case where the camera 10 has a function of the summarizing unit2040 (a case where the first computer 1000 is realized by the camera10), the summarizing unit 2040 obtains the video 30 stored in a storagedevice (for example, the memory 1060 or the storage device 1080 in FIG.3 ) inside the camera 10.

<Contents of Summary Information: S104>

The summarizing unit 2040 performs the summarizing process on the video30 and generates summary information of the video 30 (S104). Here,contents of the summary information generated by the summarizing unit2040 will be described. As described above, the summary informationindicates any information obtained from contents of the video 30.However, it is preferable for the user that viewing the summaryinformation of the video 30 enables to recognize the contents of thevideo 30 more easily than viewing the video 30 itself. In other words,it is preferable that the contents of the summary information are thosethat briefly represent important contents for the user among thecontents of the video 30.

The content important for the user is, for example, a feature of anobject captured in the video 30. Hereinafter, in a case where thesummary information indicates a feature of a certain object, the objectis referred to as “target object”.

As the target object, various objects can be handled. For example, thetarget object is a person. In another example, the target object is anymoving object described above. In another example, the target object maybe luggage (a package such as a bag or the like) carried by a person, amoving object, or the like.

The feature of the target object is, for example, a staying time, amoving time, a moving velocity, a moving state, or the like. The stayingtime represents a length of a period when the target object stays in thevideo 30. The staying here means that the target object stops or hardlymoves (for example, a size of a moving range is equal to or less than apredetermined value). The moving time represents a length of a periodwhen the target object moves in the video 30. The moving here means thatthe target object does not stay (for example, the size of the movingrange is larger than the predetermined value). The moving velocityrepresents a moving velocity (for example, an average velocity) of thetarget object during a period when the target object moves. The movingstate represents, for example, a trace of movement (such as whether thetarget object moves straight or meanderingly).

Here, in a case where the target object repeatedly moves and stays, thestaying time indicated in the summary information may be each of aplurality of staying times, or a statistical value of the plurality ofstaying times (total value, mode, average value, or the like) may beused. The same applies to the moving time, the moving velocity, and themoving state.

By using the summary information indicating the feature of staying ormovement of the target object, for example, it is possible to determinea target object to be focused and to intensively surveil the targetobject. For example, in a case where a person stays for a long time in aplace at which a person normally does not stop, it is conceivable thatthe person is a person to be focused. In addition, in a case where a bagor the like is left in a place at which luggage is not normally left, itcan be said that that luggage is suspicious and to be focused.

Note that, the feature of the target object is not limited to theexample described above. Another example of the feature of the targetobject will be described below.

The summarizing unit 2040 detects a target object from the video 30 andcomputes a feature of the target object. For example, the summarizingunit 2040 computes a change in a position of the target object bydetecting the target object from each of frames constituting the video30. The summarizing unit 2040 computes the staying time, the movingtime, the moving velocity, the moving state, and the like from thechange in the position of the target object. Note that, in a case ofdetecting a plurality of different target objects from the video 30, thesummarizing unit 2040 computes a feature for each of the target objects.

Here, in a case where the target object is a person, the summarizingunit 2040 may compute values of various attributes (hereinafter,referred to as attribute values) for the target object and include theseattribute values in the features of the target object. An attribute ofthe person is, for example, an age group, a gender, a nationality, thepresence or absence of belongings, whether or not the person is a personwith difficulty in walking, or the like. Here, the person withdifficulty in walking means a person who walks with assistance from ananimal or another person, or a person who walks using an assistancetool. The animal supporting the person with difficulty in walking is aguide dog, for example. The assistance tool used by the person withdifficulty in walking is, for example, a crutch or a wheelchair.

The attribute values of the age group are various values representingthe age group. For example, an age group (10s or 20s) or a category (achild, a young person, an elderly, or the like) representing an age isexemplified. The attribute value of the gender is male or female.

The attribute value of the nationality is a value representing a birthcountry or a living country, or a feature based on the country. Forexample, the attribute value of the nationality indicates eitherJapanese or a foreigner. In another example, the attribute value of thenationality indicates a category of countries such as Asia, Europe, orAfrica. In another example, the attribute value of the nationality mayindicate a language to be used (Japanese, English, Chinese, or thelike).

The attribute value of the presence or absence of belongings indicates,regarding various types of belongings, whether or not such thebelongings are belonged or used. For example, a walking stick, awheelchair, a baby carriage, and the like correspond to the belongings.For example, the attribute value of the presence or absence of thewalking stick represents whether or not the walking stick is belonged oris used.

The attribute value as to whether or not a person is a person withdifficulty in walking represents whether the person is supported by ananimal or another person, whether or not the person uses the assistancetool, or the like. For example, whether or not a certain person is aperson with difficulty in walking can be determined based on thepresence or absence of an animal or another person who supports theperson. For example, in a case where the summarizing unit 2040 detects ascene in which a person A is supported by another person B from thevideo 30, the summarizing unit 2040 determines that the person A is aperson with difficulty in walking. In addition, in a case where thesummarizing unit 2040 detects a scene in which a person moves togetherwith an animal having a predetermined feature such as a guide dog fromthe video 30, the summarizing unit 2040 determines that the person is aperson with difficulty in walking.

In another example, whether or not a person is a person with difficultyin walking can be determined based on the presence or absence of use ofthe assistance tool. For example, in a case of detecting a person usinga predetermined tool such as a crutch or a wheelchair from the video 30,the summarizing unit 2040 determines that the person is a person withdifficulty in walking.

By using the summary information indicating the attribute of such aperson, for example, it is possible to determine a person who may needassistance, such as an elderly, a foreigner, a missing child, a personwith difficulty in walking and to focus on and surveil the person. Inaddition, in order to handle such a person, it is possible to takemeasures such as having staff go to a place at which the person islocated.

FIG. 9 is a diagram illustrating the summary information in a tableformat. The table in FIG. 9 is referred to as a table 500. The table 500has fields of an identifier 502 and a feature 504. The identifier 502 isan identifier of the target object. The feature 504 indicates a featureof the target object determined by the identifier 502. In FIG. 9 , thefeature 504 includes a staying time 506, a moving time 508, or the like.

<Timing of Displaying Summary Information: S106>

The display control unit 2060 detects that a change in the display stateof a certain video 30 in the display system 20 satisfies a predeterminedcondition (S106). As this predetermined condition, various conditionscan be adopted. Hereinafter, some examples of the predeterminedcondition will be described. In the following description, the video30-1 is the video 30 generated by the camera 10-1.

Example 1 of Predetermined Condition

The predetermined condition is, for example, a condition that “the video30 is switched from a state in which the video 30 is not displayed tothe display system 20 to a state in which the video 30 is displayed tothe display system 20.”

FIG. 10 is the first diagram illustrating timing when displaying thesummary information of the video 30 based on the first example of thepredetermined condition. The video 30-1 is displayed to the displaysystem 20 between time t1 to time t2. On the other hand, the video 30-1is not displayed to the display system 20 between the time t2 to timet3. After the time t3, the video 30-1 is displayed to the display system20 again.

The display control unit 2060 causes the display system 20 to displaythe summary information of the video 30-1 at timing when thepredetermined condition is satisfied, that is, at the time t3.

Here, the summary information to be displayed to the display system 20by the display control unit 2060 preferably includes summary informationgenerated during a period between the first time at which the displaystate of the video 30 is switched from the first display state into thesecond display state and the second time at which the display state ofthe video 30 is switched from the second display state into the firstdisplay state. For example, in the example in FIG. 10 , the first timeis the time when a state in which the video 30 is displayed to thedisplay system 20 is switched into a state in which the video 30 is notdisplayed to the display system 20: that is, at the time t2. On theother hand, the second time is the time when a state in which the video30 is not displayed to the display system 20 is switched into a state inwhich the video 30 is displayed to the display system 20: that is, atthe time t3. That is, summary information generated during a periodbetween the time t2 and the time t3 is displayed to the display system20.

By displaying the summary information of such a period to the displaysystem 20, summary information of the video 30 during a period when thevideo 30-1 is not displayed to the display system 20, i.e. a period whenthe user cannot view the video 30-1, is displayed to the display system20. By watching the summary information at the time t3, the user caneasily recognize what is happened in an imaging range of the camera 10-1during the period when the video 30-1 cannot be viewed.

Example 2 of Predetermined Condition

The predetermined condition is, for example, a condition that “in thedisplay system 20, a state in which the video 30 is displayed in arelatively small size is switched into a state in which the video 30 isdisplayed in a relatively large size.”

FIG. 11 is a diagram illustrating a scene in which the summaryinformation of the video 30 is displayed based on the second example ofthe predetermined condition. The video 30-1 is displayed in the displayarea 24-1 of the display system 20 between the time t1 to the time t2.On the other hand, the video 30-1 is displayed in the display area 24-2of the display system 20 between the time t2 to the time t3. After thetime t3, the video 30-1 is displayed in the display area 24-1 again.

Here, the size of the display area 24-1 is larger than the size of thedisplay area 24-2. Therefore, the video 30-1 is displayed to the displaysystem 20 in a relatively small size between the time t2 to the time t3.

The display control unit 2060 causes the display system 20 to displaythe summary information of the video 30-1 at timing when thepredetermined condition is satisfied: that is, at the time t3.

In this case, for example, the display control unit 2060 causes thedisplay system 20 to display summary information generated for the video30 during a period between the time t2 and the time t3. The time t2 isthe time when a condition that “in the display system 20, a state inwhich the video 30 is displayed in a relatively large size is switchedinto a state in which the video 30 is displayed in a relatively smallsize” is satisfied. Since the period between the time t2 and the time t3is a period when the video 30-1 is displayed in a small size to thedisplay system 20, the period is a period when it is not easy for theuser to view the video 30-1. Therefore, by watching the summaryinformation regarding the video 30 during that period at the time t3,the user can easily recognize what is happened in the imaging range ofthe camera 10-1 during the period when it is not easy to view the video30-1.

Example 3 of Predetermined Condition

The predetermined condition is, for example, a condition that “in thedisplay system 20, a state in which the video 30 is displayed at aposition being less likely to come into sight of the user is switchedinto a state in which the video 30 is displayed at a position being morelikely to come into sight of the user”.

FIG. 12 is a diagram illustrating a scene in which the summaryinformation of the video 30 is displayed based on the third example ofthe predetermined condition. The video 30-1 is displayed in the displayarea 24-1 of the display system 20 between the time t1 to the time t2.On the other hand, the video 30-1 is displayed in the display area 24-2of the display system 20 between the time t2 to the time t3. After thetime t3, the video 30-1 is displayed in the display area 24-1 again.

Here, it is assumed that the display area 24-1 is at a position at whicha front direction of the user crosses the display system 20. Therefore,the display area 24-2 is far from the position at which the frontdirection of the user of the information processing apparatus 2000crosses the display system 20, as compared with the display area 24-1.Thus, it can be said that it is more difficult for the user to view thevideo 30-1 during the period between the time t2 to the time t3 thanother periods.

The display control unit 2060 causes the display system 20 to displaythe summary information of the video 30-1 at the timing when thepredetermined condition is satisfied: that is, at the time t3.

In this case, for example, the display control unit 2060 causes thedisplay system 20 to display summary information generated for the video30 during a period between the time t2 and the time t3. The time t2 isthe time when a condition that “in the display system 20, a state inwhich the video 30 is displayed at a position being less likely to comeinto sight of the user is switched into a state in which the video 30 isdisplayed at a position being more likely to come into sight of theuser”. By generating the summary information in this manner, the userwho watches the summary information can easily recognize what ishappened in the imaging range of the camera 10-1 during the period whenit is difficult to view the video 30-1.

Here, “front direction of the user” described above may be, for example,a front direction of the user's face, a front direction of the user'sbody, or a gaze direction of the user. Here, in a case where a positionof the user is fixed (for example, a case where a position of a chair onwhich the user sits is fixed), a relationship between each of thedisplay areas 24 and a position at which the front direction of the usercrosses the display system 20 is can be predetermined.

In another example, the summarizing unit 2040 may determine the frontdirection of the user by analyzing an image generated by a camera whichimages the user. In this manner, the summarizing unit 2040 can computethe relationship between each of the display areas 24 and the positionat which the front direction of the user crosses the display system 20.Note that, the camera which images the user is provided in the vicinityof the display system 20, for example. Here, as a specific method ofdetermining the front direction or the like of the user's face describedabove, an existing method can be used.

In addition, the degree of how likely it comes into sight of the usermay be associated with each of the display areas 24 in advance. Theassociation information is stored in advance in a storage deviceaccessible from the display control unit 2060.

Other Example

Timing when the summary information is displayed to the display system20 may not be limited to the timing when the display state of the video30 satisfies the predetermined condition. For example, the informationprocessing apparatus 2000 may display the summary information of thevideo 30 to the display system 20 in response to receiving an input fromthe user to select the video 30 displayed to the display system 20.

<Display State of Summary Information: S108>

As a change in the display state of the video 30 satisfies thepredetermined condition, the display control unit 2060 causes thedisplay system 20 to display the summary information of the video 30(S108). As the display state of the summary information, various statescan be adopted. Hereinafter, an example of the specific display state ofthe summary information will be described. Note that, in each of thefollowing examples, the summary information is generated for the video30-1 generated by the camera 10-1.

FIG. 13 is the first diagram illustrating the display state of thesummary information. In this example, the video 30-1 generated in realtime by the camera 10-1 (so-called live video) is displayed in thedisplay area 24 of the display system 20. The summary information of thevideo 30-1 is also displayed in the display area 24.

More specifically, the summary information of the video 30-1 issuperimposed and displayed on the live video generated by the camera10-1. The summary information of FIG. 13 represents that a target object40 captured in the video 30-1 acts in order of (1) staying for 10seconds, (2) moving for 2 seconds, (3) staying for 13 seconds, and (4)moving for 1 second. In addition, an arrow represents a trace ofmovement of the target object 40.

Note that, in a case where a plurality of target objects 40 are includedin the video 30-1, the summary information is displayed for each of thetarget objects 40.

FIG. 14 is the second diagram illustrating the display state of thesummary information. In this example, the live video generated by thecamera 10-1 is displayed in the display area 24-1. In addition, summaryinformation 50-1 of the video 30-1 is displayed in the display area 24-2instead of the display area 24-1. That is, in this example, the displayarea 24 in which the summary information of the video 30-1 is displayedis different from the display area 24 in which the video 30-1 isdisplayed.

Here, it is assumed that summary information on each of a plurality oftarget objects 40 is generated for the video 30-1. In this case, aplurality of pieces of summary information may be displayed in onedisplay area 24 (the display area 24-2 in FIG. 14 ) or may be displayedin different display areas 24. Note that, in the former case, theplurality of pieces of summary information may be displayed at the sametime or may be displayed in order.

Note that, the summary information of the video 30-1 may be displayed tothe display system 20 at timing when the video 30-1 is not displayed tothe display system 20. For example, the display control unit 2060displays the summary information of the video 30-1 in the display area24-1 of the display device 22 during a predetermined period from thetiming when the predetermined condition described above for the video30-1 is satisfied. Meanwhile, the display control unit 2060 does notdisplay the video 30 to the display system 20. After the predeterminedperiod elapses, the display control unit 2060 displays the video 30 inthe display area 24-1.

Note that, in each of the examples described above, the summaryinformation is represented by still data such as a character and afigure. However, the summary information may be generated as video data.In this case, for example, the summary information of the video 30 isgenerated by omitting some of frames of the video 30. For example,regarding a period when the target object stops, the summarizing unit2040 omits one or more frames other than the frame in which the targetobject starts stopping and the frame in which the target object endsstopping. In another example, regarding frames during a period when thetarget object moves, the summarizing unit 2040 omits one or more framesother than the frame in which the target object starts moving and theframe in which the target object ends moving.

Note that, when omitting some of the frames of the video 30, it ispreferable not to omit a frame including characteristic movement of thetarget object. For example, in a case where the target object is aperson, it is preferable not to omit frames during a period when theperson is contact with another person or the person takes a look around.

<Timing of Generating Summary Information: S104>

The summarizing unit 2040 generates summary information of the video 30(S104). Timing when the summarizing unit 2040 generates the summaryinformation is various. Hereinafter, some examples of the timing will bedescribed.

<<Timing 1 of Generating Summary Information>>

For example, the summarizing unit 2040 repeatedly analyzes the video 30at a predetermined cycle to individually generate summary informationfor a plurality of time ranges of the video 30. FIG. 15 is the firstdiagram illustrating a scene of generating the summary information. Inthis example, the summarizing unit 2040 analyzes the video 30 from thetime t1 to the time t2 at the time t2, and generates the summaryinformation 50-1 based on the result. In addition, the summarizing unit2040 analyzes the video 30 from the time t2 to the time t3 at the timet3, and generates summary information 50-2 based on the result.

Here, the target object stays for 20 seconds from the time t1 to thetime t2, and the target object stays for 30 seconds from the time t2 tothe time t3. Therefore, the summarizing unit 2040 respectively generatesthe summary information 50-1 indicating “staying time: 20 seconds” andthe summary information 50-2 indicating “staying time: 30 seconds”.

Note that, the display control unit 2060 selects summary information 50to be displayed to the display system 20 from a plurality of pieces ofsummary information 50 periodically generated for the video 30 asdescribed above. FIG. 16 is a diagram illustrating a scene in which thedisplay control unit 2060 selects the summary information 50 to bedisplayed to the display system 20.

In this example, the display control unit 2060 causes the display system20 to display the summary information 50 on the video 30 between time T1and time T2. The summary information 50 on the video 30 between the timeT1 and the time T2 is the summary information 50-2 and summaryinformation 50-3. Therefore, the display control unit 2060 causes thedisplay system 20 to display the summary information 50-2 and thesummary information 50-3.

However, a portion (time t1 to time t2) of the period from the time t1to the time t2, which is a target period of the summary information50-1, overlaps with the period from the time T1 to the time T2. Thus,the display control unit 2060 may cause the display system 20 to displaythe summary information 50-1 in addition to the summary information 50-2and the summary information 50-3.

In a case of selecting the plurality of pieces of summary information 50in this manner, the display control unit 2060 may cause the displaysystem 20 to individually display the plurality of pieces of summaryinformation 50, and perform a process (for example, statistical process)of integrating the plurality of pieces of summary information 50 intoone and cause the display system 20 to display the one summaryinformation 50 generated as a result.

Note that, generation of the summary information that is periodicallyperformed may keep being repeatedly executed (for example, from the timewhen the information processing apparatus 2000 is activated) or may bestarted from a specified timing. For example, the specified timing is“the first time when the display state of the video 30 is switched fromthe first display state to the second display state” described above.More specifically, it may be “a time when a state in which the video 30is displayed to the display system 20 is switched into a state in whichthe video 30 is not displayed to the display system 20”, “a time when inthe display system 20, a state in which the video 30 is displayed in arelatively large size is switched into a state in which the video 30 isdisplayed in a relatively small size”, or “a time when in the displaysystem 20, a state in which the video 30 is displayed at a position atwhich it is more likely to come into sight of the user is switched intoa state in which the video 30 is displayed at a position at which it isless likely to come into sight of the user.”

<<Timing 2 of Generating Summary Information>>

Also in this example, the summarizing unit 2040 repeatedly analyzes thevideo 30 at a predetermined cycle. However, the summarizing unit 2040repeatedly updates one piece of summary information 50 based on theanalysis result of the video 30.

FIG. 17 is the first diagram illustrating a scene of updating thesummary information. In this example, the summarizing unit 2040 analyzesthe video 30 from the time t1 to the time t2 at the time t2, andgenerates the summary information 50 based on the result. After then,the summarizing unit 2040 analyzes the video 30 from the time t2 to thetime t3 at the time t3, and updates the summary information 50 based onthe result. It is assumed that a staying time of the target objectbetween the time t1 and the time t2 is 20 seconds and the staying timeof the target object between the time t2 and the time t3 is 30 seconds.

In FIG. 17 , the summary information 50 is updated by overwriting. Thus,the summarizing unit 2040 overwrites contents of the summary information50 indicating “staying time: 20 seconds” with information indicating“staying time: 30 seconds”. In another example, the summarizing unit2040 may perform a process of overwriting the summary information 50with 25 seconds, which is an average value of the staying times duringthe two periods.

FIG. 18 is the second diagram illustrating the scene of updating thesummary information. FIG. 18 illustrates the same contents as in FIG. 17except for the updating method.

In FIG. 18 , the summary information 50 is updated by integrating a newanalysis result into the previous analysis result. Thus, the summarizingunit 2040 adds information indicating “staying time: 30 seconds” to thesummary information 50.

<<Timing 3 of Generating Summary Information>>

The summarizing unit 2040 may generate summary information to bedisplayed at timing when the predetermined condition described above(the condition for displaying the summary information of the video 30 tothe display system 20) is satisfied. In this case, for example, thesummarizing unit 2040 generates the summary information for the video 30during a period between a predetermined time before the above-mentionedtiming and the above-mentioned timing.

Note that, in a case where the first computer 1000 for realizing thesummarizing unit 2040 is the camera 10, when the predetermined conditionis satisfied, the display control unit 2060 (the second computer 1000)may transmit a request of generating summary information to the camera10. For example, at timing when receiving the request, the summarizingunit 2040 generates the summary information for the video 30 during aperiod between a predetermined time before the timing and the timing.The display control unit 2060 obtains the summary information generatedby the camera 10.

Example Embodiment 2

The information processing apparatus 2000 according to ExampleEmbodiment 2 is illustrated in FIG. 1 in the same manner as theinformation processing apparatus 2000 of Example Embodiment 1. Theinformation processing apparatus 2000 according to Example Embodiment 2has the same functions as the information processing apparatus 2000 ofExample Embodiment 1 except for items to be described below.

In a case of causing the display system 20 to display a plurality ofpieces of summary information respectively generated from differentvideos 30, the display control unit 2060 according to Example Embodiment2 causes the display system 20 to display the summary information inconsideration of a priority of each of the pieces of summaryinformation.

FIG. 19 is a diagram illustrating a supposed environment of theinformation processing apparatus 2000 according to Example Embodiment 2.In this example, the summary information of the video 30 is displayed inanother display area 24 different from the display area 24 in which thevideo 30 is displayed. More specifically, the display system 20 includesone display device 22, and the display device 22 includes three displayareas 24-1 to 24-3. The video 30-1 and the video 30-2 are alternatelydisplayed in the display area 24-1, a video 30-3 and a video 30-4 arealternately displayed in the display area 24-2, and any one of thepieces of summary information is displayed in the display area 24-3. Itis assumed that a priority of the summary information of the video 30-1is higher than a priority of the summary information of the video 30-3.

In this case, it is assumed that both of a change in the display stateof the video 30-1 and a change in the display state of the video 30-3satisfy the predetermined condition. Here, only one of the summaryinformation of the video 30-1 and the summary information of the video30-3 is displayed in the display area 24-3.

Therefore, the display control unit 2060 displays the summaryinformation of the video 30-1 having a higher priority among the summaryinformation of the video 30-1 and the summary information of the video30-3 in the display area 24-3. In this case, the display control unit2060 may display only the summary information of the video 30-1 in thedisplay area 24-3, or may display the summary information of the video30-1 in the display area 24-3 first and then display the summaryinformation of the video 30-3 in the display area 24-3.

Here, the process of displaying the summary information based on thepriority is necessary in a case where the number of pieces of thesummary information to be displayed is larger than the number of displayareas to be used for displaying the summary information. Such a case isnot limited to the case illustrated by using FIG. 19 .

For example, it is assumed that the display system 20 has a layoutillustrated in FIG. 7 . It is assumed that two videos 30 are alternatelydisplayed in each of display areas 24-1 to 24-9. On the other hand, thesummary information of one of the videos 30 is displayed in the displayarea 24-10.

In this case, when each of changes in the display states of two or morevideos 30 satisfies a predetermined condition, the number of the piecesof summary information to be displayed is equal to or larger than two.On the other hand, the number of display areas which can be used fordisplaying the summary information is one. Therefore, the number of thepieces of summary information to be displayed may be larger than thenumber of display areas 24 which can be used for displaying the summaryinformation. Therefore, the display control unit 2060 determines thesummary information to be displayed in the display area 24-10 accordingto the priority of the summary information to be displayed.

<Method of Determining Priority of Summary Information>

A method of determining a priority of the summary information isvarious. Hereinafter, an example of the method of determining thepriority of the summary information will be described.

<<Method 1 of Determining Priority>>

A priority is set for each of the cameras 10. The priority of the camera10 is set as a priority of summary information of the video 30 generatedby the camera 10. For example, a priority of the summary information ofthe video 30-1 is a priority associated with the camera 10-1 whichgenerates the video 30-1. Hereinafter, information indicating thepriority of the camera 10 is referred to as priority information.

FIG. 20 is a diagram illustrating the priority information in a tableformat. The table in FIG. 20 is referred to as a table 600. The table600 includes a camera identifier 602 and a priority 604. The cameraidentifier 602 represents an identifier of the camera 10. The priority604 indicates a priority associated with the camera 10.

The priority information (for example, the table 600) is stored inadvance in a storage device accessible from the display control unit2060. This storage device may be provided inside the informationprocessing apparatus 2000 or may be provided outside the informationprocessing apparatus 2000.

<Method 2 of Determining Priority of Summary Information>

A priority of summary information may be determined based on contents ofthe summary information. For example, the display control unit 2060handles any numerical value indicated in the summary information as apriority of summary information. For example, in a case where thesummary information indicates a staying time of the target object, thedisplay control unit 2060 handles a value of the staying time as thepriority of the summary information. In this manner, as the summaryinformation of the video 30 has a longer staying time of the targetobject, the priority becomes higher. However, the numerical valuehandled as a priority is not limited to the staying time.

In another example, the display control unit 2060 computes a score ofthe summary information by using a rule (for example, a function) forcomputing the score of the summary information from the contents of thesummary information, and handles the score as a priority of priorityinformation. Hereinafter, an example of a rule associating a stayingtime with a score of summary information will be described.

FIG. 21 is a diagram illustrating a relationship between the stayingtime and a priority of the summary information. The horizontal axisindicates the staying time of a person captured in the video 30, and thevertical axis indicates the score of the summary information of thevideo 30. Here, a maximum value of the score is 100.

In this example, the score of the summary information is the maximumwhen the person starts staying. As the staying time becomes longer, thescore of the summary information becomes smaller.

However, at timing when the staying time reaches a predetermined valuet1, the score of the summary information increases. In this manner, thesummary information of the person who stays for a time longer than thepredetermined value is easily displayed to the display system 20.

Note that, the rule for computing the score of the summary informationmay include a rule for increasing the score in response to occurrence ofa predetermined event. For example, the predetermined event is contactwith another person.

FIG. 22 is a diagram illustrating a temporal change in a score ofsummary information. The rule for computing the score of the summaryinformation in FIG. 22 is defined by a combination of (1) a ruleillustrated in FIGS. 21 and (2) a rule for increasing the scoreaccording to contact with another person.

In this example, a person who stays is in contact with another person atthe time t2. Thus, the score of the summary information increases at thetime t2.

The priority of the summary information may be computed by using each ofthe scores computed from a plurality of pieces of information includedin the summary information. For example, the display control unit 2060computes the priority of the summary information by using the followingEquation (1).

$\begin{matrix}{p = {\sum\limits_{i}{w_{i}*{f_{i}\left( d_{i} \right)}}}} & (1)\end{matrix}$

In Equation (1), p is a priority of summary information. w_(i) is aweight given to each piece of information i (staying time and the like)included in the summary information. d_(i) is a value of the informationi included in the summary information. f_(i) is a function for computingthe score of the summary information for the information i.

<Determination of Display Position Based on Priority>

The display control unit 2060 may determine a display position ofsummary information based on a priority of the summary information. Forexample, a priority is associated in advance with each of the displayareas 24 for displaying the summary information. The display controlunit 2060 matches the summary information with the display area 24 sothat the summary information having a higher priority is displayed inthe display area 24 having a higher priority. Here, it is preferablethat the display area 24 which the user more easily watches has a higherpriority. The priority of the display area 24 is stored in advance in astorage device accessible from the display control unit 2060.

<Hardware Configuration Example>

The information processing apparatus 2000 according to ExampleEmbodiment 2 is realized by using the computer 1000 in the same manneras Example Embodiment 1 (see FIG. 4 ). In the present exampleembodiment, each of the program modules stored in the storage 1080described above further includes a program for realizing each of thefunction described in the present example embodiment.

Advantageous Effect

When causing the display system 20 to display the pieces of the summaryinformation respectively generated for the different videos 30, theinformation processing apparatus 2000 according to the present exampleembodiment determines a display method of the summary information basedon the priority of the summary information. In this manner, for example,it is possible to make that “the user of the information processingapparatus 2000 more easily watches the summary information having ahigher priority”. Therefore, it is possible to more reliably preventimportant information from being overlooked. In addition, convenience ofthe information processing apparatus 2000 is improved for the user ofthe information processing apparatus 2000.

Although the example embodiments of the present invention are describedwith reference to the drawings, these are examples of the presentinvention, and a combination of the respective example embodiments orvarious other configurations other than the example embodiment describedabove may be adopted.

A part or all of the example embodiments may also be described as thefollowing appendixes, but are not limited to the following.

1. An information processing apparatus comprising:

a summarizing unit which obtains videos and generates summaryinformation of the obtained video by performing a summarizing process onthe obtained video, each of a plurality of cameras generating the video;and

a display control unit which causes a display unit to display the video,

wherein, in response to that a change in a display state of the video onthe display unit satisfies a predetermined condition, the displaycontrol unit causes the display unit to display the summary informationof that video.

2. The information processing apparatus according to 1,

wherein the display control unit causes the display unit to displaysummary information of a first video in response to that a display stateof the first video is switched from a state not being displayed on thedisplay unit into a state being displayed on the display unit.

3. The information processing apparatus according to 1,

wherein the display control unit causes the display unit to displaysummary information of a first video in response to that a display stateof the first video is switched from a state being displayed in a firstsize on the display unit into a state being displayed in a second sizeon the display unit, the second size being larger than the first size.

4. The information processing apparatus according to any one of 1 to 3,

wherein the summarizing unit causes the display unit to display summaryinformation of a first video generated during a period between a firsttime when the display state of the first video is switched from a firstdisplay state into a second display state on the display unit and asecond time when the display state of the first video is switched fromthe second display state into the first display state on the displayunit.

5. The information processing apparatus according to any one of 1 to 4,

wherein in a case where a change in the display state of a first videogenerated by a first camera satisfies the predetermined condition and adisplay state of a second video generated by a second camera satisfiesthe predetermined condition, the display control unit causes the displayunit to display the summary information having a higher priority betweenthe summary information of the first video and the summary informationof the second video.

6. The information processing apparatus according to 5,

wherein the display control unit obtains a priority of summaryinformation of each of the videos from a storage unit which stores thepriority of the summary information of the video for each of the videos.

7. The information processing apparatus according to 5,

wherein the display control unit computes the priority of the summaryinformation based on contents of each piece of the summary information.

8. The information processing apparatus according to any one of 1 to 7,

wherein the display control unit displays the video and the summaryinformation generated during a past period of the video in display areasdifferent from each other on the display unit.

9. The information processing apparatus according to any one of 1 to 7,

wherein the display control unit superimposes the summary informationgenerated during a past period of the video on the video and causes thedisplay unit to display the superimposed video.

10. The information processing apparatus according to any one of 1 to 8,

wherein the display control unit causes the display unit not to displaythe video while the display unit displays the summary information of thevideo.

11. A control method executed by a computer, the control methodcomprising:

a summarizing step of obtaining videos and generating summaryinformation of the obtained video by performing a summarizing process onthe obtained video, each of a plurality of cameras generating the video;and

a display control step of causing a display unit to display the video,

wherein in the display control step, in response to that a change in adisplay state of the video on the display unit satisfies a predeterminedcondition, the display unit displays the summary information of thatvideo.

12. The control method according to 11,

wherein in the display control step, the display unit displays summaryinformation of a first video in response to that a display state of thefirst video is switched from a state not being displayed on the displayunit into a state being displayed on the display unit.

13. The control method according to 11,

wherein in the display control step, the display unit displays summaryinformation of a first video in response to that a display state of thefirst video is switched from a state being displayed in a first size onthe display unit into a state being displayed in a second size on thedisplay unit, the second size being larger than the first size.

14. The control method according to any one of 11 to 13,

wherein in the summarizing step, the display unit displays the summaryinformation of a first video generated during a period between a firsttime when the display state of the first video is switched from a firstdisplay state into a second display state on the display unit and asecond time when the display state of the first video is switched fromthe second display state into the first display state on the displayunit.

15. The control method according to any one of 11 to 14,

wherein in a case where a change in the display state of a first videogenerated by a first camera satisfies the predetermined condition and adisplay state of a second video generated by a second camera satisfiesthe predetermined condition, in the display control step, the displayunit displays the summary information having a higher priority from thesummary information of the first video and the summary information ofthe second video.

16. The control method according to 15,

wherein in the display control step, a priority of summary informationof each of the videos is obtained from a storage unit which stores thepriority of the summary information of the video for each of the videos.

17. The control method according to 15,

wherein in the display control step, the priority of the summaryinformation is computed based on contents of each piece of the summaryinformation.

18. The control method according to any one of 11 to 17,

wherein in the display control step, the video and the summaryinformation generated during a past period of the video are displayed indisplay areas different from each other on the display unit.

19. The control method according to any one of 11 to 17,

wherein in the display control step, the summary information generatedduring a past period of the video is superimposed on the video and thedisplay unit displays the superimposed video.

20. The control method according to any one of 11 to 18,

wherein in the display control step, the display unit does not displaythe video while the display unit displays the summary information of thevideo.

21. A program causing a computer to execute each step of the controlmethod according to any one of 11 to 20.

1. An information processing apparatus comprising: at least one memorystoring instructions; and at least one processor configured to executethe instructions to: display a first video on a first display area of adisplay device; obtain summary information of the first video; receivean instruction to display the first video of the first area to a secondarea; and display the first video with the summary information on thesecond area in response to receive the instruction to display the firstvideo of the first area to a second area.
 2. The information processingapparatus according to claim 1, wherein the second area is configured todisplay a second video before receiving the instruction to display thefirst video of the first area to the second area.
 3. The informationprocessing apparatus according to claim 1, wherein the second area islarger than the first area.
 4. The information processing apparatusaccording to claim 1, wherein the second area is closer to center of thedisplay device than the first area.
 5. The information processingapparatus according to claim 1, wherein the summary information includesa trajectory of a target included in the first video.
 6. A dataprocessing method comprising: displaying a first video on a firstdisplay area of a display device; obtaining summary information of thefirst video; receiving an instruction to display the first video of thefirst area to a second area; and displaying the first video with thesummary information on the second area in response to receive theinstruction to display the first video of the first area to a secondarea.
 7. The data processing method according to claim 6, wherein thesecond area is configured to display a second video before receiving theinstruction to display the first video of the first area to the secondarea.
 8. The data processing method according to claim 6, wherein thesecond area is larger than the first area.
 9. The data processing methodaccording to claim 6, wherein the second area is closer to center of thedisplay device than the first area.
 10. The data processing methodaccording to claim 6, wherein the summary information includes atrajectory of a target included in the first video.
 11. A non-transitorycomputer-readable storage medium storing a computer program causing acomputer to execute: displaying a first video on a first display area ofa display device; obtaining summary information of the first video;receiving an instruction to display the first video of the first area toa second area; and displaying the first video with the summaryinformation on the second area in response to receive the instruction todisplay the first video of the first area to a second area.
 12. Thenon-transitory computer-readable storage medium according to claim 11,wherein the second area is configured to display a second video beforereceiving the instruction to display the first video of the first areato the second area.
 13. The non-transitory computer-readable storagemedium according to claim 11, wherein the second area is larger than thefirst area.
 14. The non-transitory computer-readable storage mediumaccording to claim 11, wherein the second area is closer to center ofthe display device than the first area.
 15. The non-transitorycomputer-readable storage medium according to claim 11, wherein thesummary information includes a trajectory of a target included in thefirst video.